r': 


M  114  fl  DISTRIBUTED  HVTOTHESIS-TESTim  TEM  DECISION  PROBLEM 
.  HITN  COHNUNICBTION. .  <U>  MASSACHUSETTS  INST  OF  TECH 
CAHBRIOOE  LAO  FOR  INFORMATION  AND  D. . 

UNCLASSIFIED  J  PAPASTAVROU  ET  AL.  FEB  8£  LIDS-P-ISTO  T/0  17/2 


:■>  ' 
r‘j 


Februenj  1986 


UDS-P-1538 


A  DISTRIBUTED  HYPOTHESIS-TESTING 
TEAM  DECISION  PROBLEM  WITH  ^ 
COMMUNICATIONS  COST*  1 


DTIC 

I^ELECTEr 

L  APR  1  7 1986 


Jason  Papastavrou** 
Michael  Athans** 


This  document  has  been  approved 
for  public  release  and  sale;  its 
distributiorr  is  unlimited. 


\  ;  ABSTRACT 

in  this  paper  we  formulate:  r  and  solve  y  a  distributed  binanj 
hypothesis'testing  problem.  We  consider  a  cooperative  team  that  consists 
of  two  decision  makers  (DM‘s);  one  Is  refered  to  as  the  primary  DM  and  the 
other  as  the  consulting  DM.  The  team  objective  Is  to  carry  out  binary 
hypothesis  testing  based  upon  uncertain  measurements.  The  primary  DM 
can  declare  his  decision  based  only  on  Its  own  measurements;  however,  In 
ambiguous  situations  the  primary  DM  can  ask  the  consulting  DM  for  an 
opinion  and  It  Incurs  a  communications  cost.  Then  the  consulting  DM 
transmits  either  a  definite  recommendation  or  pleads  Ignorance.  The 
primary  DM  has  the  responsibility  of  making  a  final  definitive  decision. 
The  team  objective  Is  the  minimization  of  the  probability  of  error,  taking 
Into  account  different  costs  for  hypothesis  misclassificatlon  and 
communication  costs.  Numeiical  results  are  Included  to  demonstrate  the 
dependence  of  the  different  decision  thresholds  on  the  problem 
parameters.  Including  different  perceptions  of  the  prior  Information. 
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1.  Introduction  and  Motivation. 

in  this  paper  we  formulate,  solve,  and  analyze  a  distributed  hypothesis¬ 
testing  problem  which  Is  an  abstraction  of  a  wide  class  of  team  decision 
problems.  It  represents  a  normative  version  of  the  'second-opinion' 
problem  In  which  a  primary  decision  maker  (DM)  has  the  option  of 
soliciting,  at  a  cost,  the  opinion  of  a  consulting  DM  when  faced  with  an 
ambiguous  Interpretation  of  uncertain  evidence. 

1.1  Mollvatlna  Examples. 

Our  major  motivation  for  this  research  Is  provided  by  generic  hypothesis¬ 
testing  problems  In  the  field  of  Command  and  Control.  To  be  specific, 
consider  the  problem  of  target  detection  formalized  as  a  binary  hypothesis 
testing  problem  (  ^  means  no  target,  while  denotes  the  presense  of  a 

target  ).  Suppose  that  Independent  noisy  measurements  are  obtained  by 
two  geographically  distributed  sensors  (Figure  1).  One  sensor,  the  primary 
DM,  has  final  responsibility  for  declaring  the  presense  or  absence  of  a 
target,  with  different  costs  associated  with  the  probability  of  false  alarm 
versus  the  probability  of  missed  detection.  If  the  primary  DM  relied  only 
on  the  measurements  of  his  own  sensor,  then  we  have  a  classical 
centralized  detection  problem  that  has  been  extensively  analyzed;  see,  for 
example,  Van  Trees  HI.  If  the  actual  measurements  of  the  second  sensor 
were  communicated  to  the  primary  DM,  we  nave  once  more  a  classical 
centralized  detection  problem  In  which  we  have  two  Independent 
measurements  on  the  same  hypothesis;  In  this  case,  we  require 
communication  of  raw  data  and  this  Is  expensive  both  from  a  channel 
bandwidth  point  of  view  and,  perhaps  more  Importantly,  because  radio  or 
acoustic  communication  can  be  Intercepted  by  the  enemy. 

Continuing  with  the  target  detection  problem,  we  can  arrive  at  the  model 
that  we  shall  use  In  the  sequel  by  making  the  followlnq  assumptions  which 
model  the  desire  to  communicate  as  little  as  possible.  The  primary  DM  can  ^ 
look  at  the  data  from  his  own  sensor  and  attempt  to  arrive  at  a  decision  ;a4i 
using  a  llkellhood-ratio  test  (Irt),  which  yields  a  threshold  test  In  the  ' 
llnear-Gausslan  cose.  Quite  often  the  primary  DM  can  be  confident  fibout 

the  quality  of  his  decision.  However,  we  can  Imagine  that  there  will  be - 1 

Instances  that  the  data  will  be  close  to  the  decision  threshold, _ _ 

corresponding  to  an  ambiguous  situation  for  the  primary  DM.  In  such  cases 
It  may  pay  off  to  Incur  a  communications  cost  and  seek  some  Informotlon'i^'-^m^y 
from  the  other  available  sensor.  It  remains  to  establish  what  Is  the  nature 
of  the  Information  to  be  transmitted  beck  to  the  primary  DM.  “ 


□  □ 


In  our  model,  we  assume  the  existence  of  a  consulting  DM  having  access  to 
the  data  from  the  other  sensor.  We  assume  that  the  consulting  DM  has  the 
ability  to  mop  the  raw  data  from  his  sensor  Into  decisions.  The  consulting 
DM  Is  'activated*  only  at  the  request  of  the  primary  DM.  it  Is  natural  to 
speculate  that  Its  advise  will  be  ternary  in  nature:  YES,  I  think  there  Is  a 
target;  NO,  I  do  not  think  there  Is  a  target;  and,  SORRY,  NOT  SURE  MYSELF. 
Note  that  these  transmitted  decisions  In  general  require  less  bits  than  the 
raw  sensor  data,  hence  the  communication  Is  cheap  end  more  likely  to 
escape  enemy  Interception.  Then,  the  primary  DM  based  upon  the  message 
received  from  the  consulting  DM  has  the  responsibility  of  making  the  final 
binary  teem  decision  on  whether  the  target  Is  present  or  absent. 

The  need  for  communicating  with  small-bit  messages  can  be  appreciated 
If  we  think  of  detecting  an  enemy  submarine  using  passive  sonar(F1gure  2). 
We  associate  the  primary  DM  with  an  attack  submarine,  and  the  consulting 
DM  with  a  surface  destroyer.  Both  have  towed-array  sonar  capable  of 
long-range  enemy  submarine  detection.  Request  for  Information  from  the 
submarine  to  the  destroyer  can  be  Initiated  by  having  the  sub  eject  a  slot- 
buoy  with  a  prerecorded  low-power  radio  message.  A  short  active  sonar 
pulse  can  be  used  to  transmit  the  recommendation  from  the  destroyer  to 
the  submarine.  Thus,  the  submarine  has  the  choice  of  obtaining  a  'second 
opinion'  with  minimal  compromise  of  Its  covert  mission. 

Of  course,  target  detection  Is  only  an  example  of  more  general  binary 
hypothesis-testing  problems.  Hence,  one  can  readily  extend  the  basic 
distributed  team  decision  problem  setup  to  other  situations.  For  example. 
In  the  area  of  medical  diagnosis  we  Imagine  a  primary  physician 
Interpreting  the  outcomes  of  several  tests.  In  case  of  doubt,  he  sends  the 
patient  to  another  consulting  physician  for  other  tests  ( at  a  dollar  cost ), 
and  seeks  his  recommendation.  However,  the  primary  physician  has  the 
final  diagnostic  responsibility.  Similar  scenarios  occur  In  the  Intelligence 
field  where  the  "compartmentallzatlon"  of  sensitive  data,  or  the 
protection  of  a  spy,  dictate  Infrequent  and  low-bit  communications.  In 
more  general  military  Command  and  Control  problems,  we  seek  Insight  on 
formalizing  the  need  to  break  EMCON,  and  at  what  cost,  to  resolve  tactical 
situation  assessment  ambiguities. 


1.2  Literature  Review. 


The  solution  of  distributed  decision  problems  Is  quite  a  bit  different,  and 
much  more  difficult,  as  compared  to  their  centralized  counterparts.  Indeed 
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there  Is  only  a  handful  of  papers  that  deal  with  solutions  to  distributed 
hypothesis-testing  problems.  The  first  attempt  to  Illustrate  the 
difficulties  of  dealing  with  distributed  hypothesis-testing  problems  was 
published  by  Tenney  and  Sandell  (2);  they  point  out  that  the  decision 
thresholds  are  In  general  coupled.  Ekchlan  [3]  and  Ekchlan  and  Tenney  [4] 
deal  with  detection  networks  In  which  downstream  Dtt's  make  decisions 
based  upon  their  local  measurements  and  upstream  DU  decisions.  Kushner 
and  Pacut  (51  Introduced  a  delay  cost  (  somewhat  similar  to  the 
communications  cost  in  our  model )  in  the  case  that  the  observations  hove 
exponential  distributions,  and  performed  a  simulation  study.  Recently, 
Chair  and  Varshney  I6l  have  pointed  out  how  the  results  In  (2)  can  be 
extended  In  more  general  settings.  Boettcher  [7]  and  Boettcher  and  Tenney 
[8],  [9],  have  shown  how  to  modify  the  normative  solutions  In  [4]  to  reflect 
human  limitation  constraints,  and  arrive  In  at  normotlve/desciiptlve 
model  that  captures  the  constraints  of  human  Implementation  In  the 
presense  of  decision  deadlines  and  Increasing  human  workload; 
experiments  using  human  subjects  showed  close  agreement  with  the 
predictions  of  their  normotlve/desciiptlve  model.  Finally,  Tsitsiklls  1 10) 
and  Tsitsiklls  and  Athans  (111  demonstrate  that  such  distributed 
hypothesis-testing  problems  are  NP-complete;  their  research  provides 
theoretical  evidence  regarding  the  Inherent  complexity  of  solving  optimal 
distributed  decision  problems  as  compared  to  their  centralized 
counterparts  ( which  are  trivially  solvable ). 

J.3  Contributions  of  this  Research. 

The  main  contribution  of  this  paper  relates  to  the  formulation  and  optimal 
solution  of  the  team  decision  problem  described  above.  Under  the 
assumption  that  the  measurements  are  conditionally  Independent,  we  show 
that  the  optimal  decision  rules  for  both  the  primary  end  the  consulting  DM 
are  deterministic  and  ere  expressed  as  likelihood-ratio  tests  with 
constant  thresholds  which  ere  tightly  coupled  (see  Section  3  and  the 
Appendix ). 

When  we  specialize  the  general  results  to  the  case  that  the  observations 
are  linear  and  the  statistics  are  Gaussian,  then  we  are  able  to  derive 
explicit  expressions  for  the  decision  thresholds  for  both  the  primary  and 
consulting  Oil's  (  see  Section  4  ).  These  threshold  equations  are  tightly 
coupled,  thereby  necessitating  an  iterative  solution.  They  provide 
clear-cut  evidence  that  the  Oil's  Indeed  operate  as  team  members;  their 
optimal  thresholds  are  very  different  from  those  that  they  would  use  In 
isolation,  I.e.  In  a  non-team  setting.  This,  of  course,  was  the  case  In  other 
versions  of  the  distributed  hypothesis-testing  problem,  e.g.  (21. 
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The  numerfcal  sensitivity  results  (  summarized  in  Section  5  }  for  the 
1inear*Gaussian  case  provide  much  needed  intuitive  understanding  of  the 
problem  and  concrete  evidence  that  the  team  members  operate  in  a 
more-or-less  intuitive  manner,  especially  after  the  fact.  We  study  the 
Impact  of  changing  the  communications  cost  and  the  measurement 
accuracy  of  each  DM  upon  the  decision  thresholds  end  the  overall  team 
performance.  In  this  manner  we  can  obtain  valuable  insight  on  the  optimal 
communication  frequency  between  the  Dh’s.  As  to  be  expected,  as  the 
communication  cost  Increases,  the  frequency  of  communication  (and 
asking  for  a  second  opinion)  decreases,  and  the  team  performance 
approaches  that  of  the  primary  Dll  operating  in  isolation.  In  addition,  we 
compare  the  overall  distributed  team  performance  to  the  centralized 
version  of  the  problem  in  which  the  primary  DM  had  access,  at  no  cost,  to 
bcth  sets  of  observations.  In  this  manner,  we  can  study  the  degree  of 
inherent  performance  degradation  to  be  expected  as  a  consequence  of 
enforcing  the  distributed  decision  architecture  in  the  overall  decision 
making  process. 

Finally,  we  study  the  team  performance  degradation  when  one  of  the  team 
members,  either  the  primary  or  the  consulting  DM,  has  an  erroneous 
estimate  of  the  hypotheses  prior  probabilities.  This  corresponds  to  mildly 
different  mental  models  of  the  prior  situation  assesment;  see  Athens  [121. 
As  expected  the  team  performance  is  much  more  sensitive  to 
misperceptions  by  the  primary  DM  as  compared  to  similar  misperceptions 
by  the  consulting  DM.  This  Implies  that,  if  team  training  reduces 
misperceptions  on  the  part  of  the  DM's,  the  greatest  payoff  is  obtained  in 
training  the  primary  DM. 


2.  Problem  Definition 

The  problem  is  one  of  hypothesis  testing.  The  team  has  to  choose 
among  two  alternative  hypotheses  and  H,,  with  a  priori  probabilities 

P(Ho)=Po  P(H,)=p,  (1) 

Each  of  two  DM*s,  one  called  primary  (DM  A)  and  one  consulting  (DM  B), 
receives  an  uncertain  measurement  and  y^  respectively  (Figure  1), 

distributed  with  known  joint  probability  density  functions 
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^  (2) 

The  fine]  decision  of  the  team  ly  (0  or  1,  indicating  ^  or  H,  to  be 
true)  is  the  responsibility  of  the  primary  DM.  DM  A  initially  makes  a 
preliminary  decision  where  it  can  either  decide  (0  or  1)  on  the  basis  of 

its  own  data  (le  14),  or  at  a  cost  (C2O)  can  solicit  DM  B's  opinion  (u^=i), 

prior  to  making  the  commital  decision. 

The  consulting  DM's  decision  u^  consists  of  three  distinct  messages 

(call  them  :  x,v  and  z)  and  is  activated  only  when  asked.  We  decided  to 
assign  three  messages  to  DM  B,  because  we  wanted  to  have  one  message 
indicating  each  of  the  two  hypotheses  and  one  message  indicating  that  the 
consulting  DM  is  'not  sure.‘  In  fact,  we  proved  that  the  optimal  content  for 
the  messages  of  DM  B  is  the  one  mentioned  above. 

When  the  message  from  DM  B  is  received,the  burden  shifts  back  to 
the  primary  DM,  which  Is  called  to  make  the  commital  decision  of  the  team 
based  on  his  own  data  and  the  information  from  the  consulting  DM. 

We  now  define  the  following  cost  function : 

J;{0,l}x{Ho,H^}-»R  (3) 

with  being  the  cost  incurred  by  the  team  choosing  Uf,  when  is 
true. 

Then,  the  optimality  criterion  for  the  team  is  a  function 

J*:{0,1,I}x{0,1}x{Hq,H,}-^R  (4) 

with ; 

r  J(Uf,K)-»C  ;  u„si  (information  requested) 

-  (5) 

J(Uf,H^)  ;  otherwise 

.  s^t^lure  or  the  problem  is  the  usual  cost  structure  used 

the  non-negative 

commufllcatlofrcolt'- w'nich'the  leam^rfiiir^Mhen  the  DM  A  decides  to 
obtain  the  consuUing'DM's'informatlon.  ' ' 

Remark  :  According  to  the  rules  of  the  problem,  when  the  preliminary 
decision  u^,  of  the  primary  DM  is  0  or  1,  \hen  the  final  team  decision  Is  0  or 

t  respectively  ( le  V-^)=1  for  1=0,1 ). 


The  objective  of  the  decision  strategies  will  be  to  minimize  the 
expected  cost  Incurred 


min  E(J*(u^,u^,H)l  (6) 

where  the  minimization  is  over  the  decision  rules  of  the  two  OMs.  Note 
that  the  decision  rule  of  the  consulting  DM  is  implicitly  Included  In  the 
cost  function,  through  the  final  team  decision  Uf  (which  Is  a  function  of 

the  decision  of  the  consulting  DM). 

All  the  prior  Information  Is  known  to  both  DMs.  The  only  Information 
they  do  not  share  Is  their  observations.  Each  DM  knows  only  Us  own 
observation  and,  because  of  the  conditional  Independence  assumption, 
nothing  about  the  other  DM‘s  observation. 

The  problem  can  now  be  stated  as  follows : 

Probism :  Given  t^,,  p,,  the  distributions  P(y„.yp  I  Hp  for  1=0,1  with 
y^sY^,  and  the  cost  function  J*,  find  the  decision  rules  u^,Uj  and  u^  as 


functions 

{0,1,0 

(7) 

Yj:  V,-»(x,v,z) 

(8) 

e.nd 

Yf :  Y^x  {x,v,z}-+{0,l} 

(9) 

(subject  to ;  P(u^=i  1  u^^=l)=1  for  1=0,1),  which  minimize  the  expected  cost. 

NOTE  :  The  centralized  counterpart  of  the  problem,  where  a  single  DM 
receives  both  observations  Is  a  well  known  problem.  The  solution  is 
deterministic  and  given  by  a  likelihood  ratio  test  (Irt).  That  is : 

(10) 

with 

Y.(y..y»)={  , 

;  AM,)  a 
;  Otherwise 

where 


e 

A(y„,yn)  =  lP(y„.yj,lHo)Pol/lP(y„,y^lH,)p,l 

=  P(Ho  I  y^^y^)/ P(H,  I  y^,yjj)  (12) 

and  t  ts  0  precomputed  threshold 

t  =  )-  J(  1  ,H, )]/  IJ(  1  .Hq)-  J(0,Ho)I  ( 1 3) 

provided  J(1,Hq)>  J(0,F^)  .  Thus,  the  difficulty  of  our  problem  arises 

because  of  Its  decentralized  nature. 

We  will  show  that,  under  certain  assumptions,  the  most  restrictive 
of  which  Is  conditional  Independence  of  the  observations,  the  optimal 
decision  rules  for  the  Problem  are  deterministic  and  given  by  irt's  with 
constant  thresholds.  The  thresholds  of  the  two  DMs  ore  coupled.  Indicating 
that  the  DMs  work  as  a  team  rather  than  Individuals. 


3.  About  the  Solution  to  the  Seneral  Problem 

In  order  to  be  able  to  solve  the  Problem ,  we  moke  the  following 
assumptions. 

ASSUMPTION  1  :  J(1,Ho)>J(0,Hq)  ;  J(0,H,)>  J(1,H,)  (14) 

or  It  Is  more  costly  for  the  team  to  err  than  to  be  correct. 

This  logical  assumption  is  made  In  order  to  motivate  the  team  members  to 
ovoid  erring  and  In  order  to  enable  us  to  algebraically  put  the  optimal 
decisions  In  Irt  form. 


ASSUMPTION  2:  P(y,  ly,j,H,)=  P(yjH,)  ;  P(yp  ly„,H,)=  P(yp  IH,)  ;  1=0,1  (15) 

or  the  observations  y,  and  y^  ore  conditionally  Independent. 


This  assumption  removes  the  dependence  of  the  one  observation  on  the 
other  and  thus  allows  us  to  write  the  optimal  decision  rules  os  Irt's  with 
constant  thresholds. 
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ASSUMPTION  3 ;  Without  loss  of  oeneralttu  assume  that : 

|U,=I,^^)  P(Up=V  IU,=I,Ho)  P(Ugs2  lu,=l,Ho) 

P(Up=x  |u„=I,H  I )  P(Up=v  |u,=i.H, )  P(u^=z  lu„=I,H, ) 


This  assumption  is  made  in  order  to  distinguish  between  the  messages  of 
DM  B. 


As  shown  in  detail  in  the  Appendix,  the  optimal  decision  rules  for 
all  three  decisions  of  our  problem  (u^,  Ur )  are  given  by  deterministic 

functions  which  are  expressed  as  likeiihood  ratio  tests;  with  constant 
thresholds.  The  three  thresholds  of  the  primary  DM  (two  for  u^  and  one 

for  u, )  and  the  two  thresholds  of  the  consulting  DM  (for  u^ )  can  not  be 

obtained  in  closed  form.  They  are  couoled.  that  is  the  thresholds  of  one  DM 
are  given  as  functions  of  the  thresholds  of  the  other  DM. 

Another  important  result  is  that,  when  the  optimal  decision  rules 
are  employed  and  the  consulting  DM's  decision  is  x  (or  z),  then  the  optimal 
final  decision  rule  of  the  primary  DM  is  glways  0  (or  1) ; 

P(u^O  I  u„sl,Uj,=x,y^)=l  for  all  y„€  (y„l  P(u„=i  I  y„)=l,  y^e  Y„}  (17) 

and 

P(Up  1  I  u„=l,Up=z,yJ=  1  for  all  y^e  {y„  I  P(u^=l  I  y^)=  1 ,  y„6  Y„}  ( 1 8) 

Thus,  we  can  simplify  our  notation  by  changing  the  DM  B  decisions  from  x 
to  0,  from  z  to  1  and  from  v  to  7  (which  is  interpreted  os  :*l  am  not  sure"). 
The  team's  decision  process  con  be  now  described  os  follows  ;  Each  of  the 
two  DMs  receives  on  observation.  Then,  the  primary  DM  can  either  moke  the 
final  decision  (0  or  1)  or  can  decide  to  incur  the  communication  cost 
(u^sl)  and  pass  the  responsibility  of  the  final  decision  to  the  consulting 

DM.  When  called  upon,  the  consulting  DM  can  either  moke  the  final  decision 
or  shift  the  burden  bock  to  DM  A  (Up=?),  in  which  cose  the  primary  DM  is 

forced  to  moke  the  final  decision,  based  on  its  own  observation  (yj  and 

the  fact  that  DM  B  decided  Up=?  . 

A  detailed  presentation  of  the  facts  discussed  above  con  be  found  in 
the  Appendix. 


4.  A  Gaussian  Example 


We  now  present  detailed  threshold  equations  for  the  case  where  the 
probability  distributions  of  the  two  observations  ore  Gaussian.  We 
selected  the  Gaussian  distribution,  despite  Us  cumbersome  algebraic 
formulae,  because  of  Its  generality.  Our  objective  Is  to  perform  numerical 
sensitivity  analysis  to  the  solution  of  this  example.  In  order  to  gain 
Information  on  the  team  'activities.' 

We  assume  that  the  observations  ore  distributed  with  the  following 
Gaussian  distributions : 

y„-N(jt.o«^)  ;  yp-N(it.o^2) 

The  two  alternative  hypotheses  ore  : 

or 

Without  loss  of  generality,  assume  that  : 

1^0  <  ^^1 

The  rest  of  the  notation  Is  the  some  as  In  the  general  problem 
described  above. 

We  can  show  that  the  optimum  decision  rules  for  this  example  are 
given  by  thresholds  on  the  ottservdtion  axes,  os  shown  In  Figure  3.  Before 
presenting  the  equations  of  the  thresholds,  we  define  some  variables. 

’ :  lower  threshold  of  DM  A  V :  upper  threshold  of  DM  A 

'P  ^ ;  threshold  for  the  final  decision  of  DM  A 

'Pp' :  lower  threshold  of  DM  B  '•  upper  threshold  of  DM  B 


(19) 


(20) 


(21) 


(I)jJ(k)  =  I  (2x)-Q-5  exp(- 0.5x2)  dx  for  Ua.p  ;  J=l.f,u  ;  k=0,1 
-00 

Note  that  the  above  function  Is  the  well-known  error  function,  presented 
with  notatlonal  modifications  to  fit  the  purposes  of  the  problem. 


(22) 


1 1 

=  0.5  (<l>p“(o)-Y(f)] 

<p^“(o)-<i>p’(o)+<i>p'‘(i  ) 

w3.  -1 - L - S - L_  (24) 

W^=  0.5[<I»p“(0)-<I»p^(1)l  (25) 

¥«*  =  (}io*}^i  ♦  Io^2  ]n(p^/(  j  -p^))  (26) 

¥p*  =  (v^*V^,)/2  *  IOp2  /(;i,-n^))  ln[Po/(1-Po)l  (27) 


In  (26)  and  (27),  the  (centralized)  maximum  likelihood  estimators  for  each 
DM  are  defined. 


COROLLARY  1  :  If  P(u^=i)>0  (i.e.  information  is  requested  for  some  yj 

and  If  P(Ups?  I  u^=i)>0  (I.e.  'I  am  not  sure*  Is  relumed  for  some  y^,  when 

information  is  requested),  then  the  optimal  final  decision  rule  of  the 
primary  DM  is  a  deterministic  function  defined  by  : 


y«  >  yJ 


(28) 


where  : 


(29) 


COROLLARY  2  :  If  P(u  =I)>0  (I.e.  information  is  requested  for  some  y  ) 

and  the  primary  DM’s  final  decision  rule  is  the  one  given  by  Corollary  1, 
then  the  optimal  decision  rule  of  the  consulting  DM  is  a  deterministic 
function  defined  by ; 

0  if  yp  s  fp’ 

Yp(yp)=[  7  tf  V'yp^V  ^30) 

1  V  % 


REMARK  :  Observe  that  the  equations  of  all  the  thresholds  include  (and 
possibly  reduce  to)  a  'centralized'  pert  indicating  the  relation  of 
our  problem  to  Its  centralized  counterpart. 


5.  NUMERICAL  SENSITIVITY  ANALYSIS 

We  now  perform  sensitivity  analysis  to  the  solution  of  the  Gaussian 
example.  Our  objective  is  to  analyze  the  effects  on  the  team  performance 
from  varying  the  parameters  of  our  problem,  in  order  to  obtain  better 
understanding  of  the  decentralized  team  decision  mechanism.  We  vary  the 
quality  of  the  observations  of  each  DM  (the  variance  of  each  DM),  the  a 
priori  likelihood  of  the  hypotheses  and  the  communication  cost.  Finally,  we 
study  the  effects  of  different  a  priori  knowledge  for  each  DM. 

We  use  the  following  ‘minimum  error*  cost  function : 


0  ;  u^  S  i 

1  ;  iv#i 


We  do  not  need  to  vary  the  cost  function,  because  this  would  be 
mathematically  equivalent  to  varying  the  a  priori  probabilities  of  the  two 
hypotheses. 


cr  =  cost  incured  if  the  consulting  DM  makes  the  decision  alone 


We  distinguish  two  cases  depending  on  the  cost  associated  with  the 
Information  (ie  the  of  quality  of  Information) 

CASE  1  :  min(Po,l-Po)i  C1**C 

As  the  variance  of  the  primary  DM  increases,  it  becomes  less  costly  for 
the  team  to  hove  the  primary  DM  always  decide  the  more  likely  hypothesis, 
than  request  for  information.  This  occurs  becayse  the  observation  of  DM  A 
becomes  increasingly  worthless.  Thus,  the  primary  DM  progressively 
ignores  its  observation  and  in  order  to  minimize  cost  has  to  choose 


between  'de  facto'  deciding  the  more  likely  hypothesis  (and  Incuiing  cost 
equal  to  the  probability  of  the  least  likely  hypothesis)  or  'de  facto' 
requesting  for  Information  (and  thus  Incuring  the  communication  cost  plus 
the  cost  of  the  consulting  DM).  In  this  case,  the  prior  Is  less  than  the 
latter  and  so  the  optimum  decision  of  the  primary  DM,  as  Its  variance 
tends  to  Infinity  Is  to  always  decide  the  more  likely  hypothesis  (Figure  4, 
Pq=  .8).  Thus  : 

11m  P(u„=i)-»0 

-»oo 

Moreover,  the  percentage  gain  In  cost  achieved  by  the  team  of  DMs, 
relative  to  the  cost  Incured  by  a  single  DM  obtaining  a  single  observation, 
assymptotlcally  goes  to  0,  as  the  variance  of  the  primary  DM  goes  to 
Infinity  (Figure  5,  Pq=  .8). 

An  Interesting  Insight  can  be  obtained  from  Figure  5  (  Pqs  .8).  As  the 

variance  of  the  primary  DM  Increases  the  percentage  Improvement  In  cost 
(defined  above)  Is  Initlallu  Increasing  and  then  decreasing  assymptotlcally 
to  zero.  The  reason  for  this  Is  that  for  very  small  variances,  the 
observations  of  the  primary  DM  are  so  good  that  It  does  not  need  the 
Information  of  the  consulting  DM.  As  the  variance  Increases,  the  primary 
DM  makes  better  use  of  the  Information  and  so  the  percentage 
Improvement  Increases.  But,  at  a  certain  point  os  the  quality  of  the 
observations  worsens,  the  primary  DM  finds  less  costly  to  start  declaring 
more  often  the  more  likely  hypothesis  (ie  to  bios  Its  decision  towards  the 
more  likely  hypothesis)  than  requesting  for  Information,  for  reasons 
mentioned  above,  and  so  the  percentage  Improvement  from  then  on 
decreases. 

CASE  2  :  min(Po,l-Po)>  C1*^C 

With  reasoning  similar  to  the  above,  we  obtain  that  (Figure  4,  Pjji  .5) : 

lim  P(u„=l)-*1 
-»  00 

Moreover,  the  percentage  improvement  Is  strictly  Increasing  (and  keeps 
incresing  to  a  precomptutable  limit ;  Figure  5,  Pg=  .5).  This  reinforces  the 

last  point  we  made  In  (Case  I)  above.  Since  In  the  present  case  It  Is 
always  less  costly  for  the  primary  DM  to  request  and  use  the  Information 
than  to  bias  Its  decision  towards  the  more  llksly  hypothesis,  the 
percentage  Improvement  curve  does  not  exhibit  the  non-monotonIc 
behavior  observed  In  (Case  !)  above  ( where  P^:  .8). 
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5.2  Effects  of  vanjino  the  oualitu  of  the  observations  of  the 
ConsuHIno  DM 

As  the  vQtience  of  the  consulting  DM‘s  observetlons  Increases,  less 
information  Is  requested  by  the  primary  DM,  that  Is  the  primary  DM's  upper 
and  lower  thresholds  move  closer  to  each  other  (Figure  6).  This  Is 
something  we  expected,  since  Information  of  lesser  quality  Is  less 
profitable  (more  costly)  to  the  team  of  DMs. 

We  should  note  here  that  the  thresholds  of  a  DM  Is  an  alternative  way 
of  representing  the  probabilities  of  the  DM's  decisions,  since  the  decision 
regions  are  characterized  by  the  thresholds.  For  example : 

P(u.=l)=2|  P(y.lH)P(H) 

H  y,:  »,'<  y.<  f.“ 

The  thresholds  of  the  consulting  DM  demonstrate  some  Interesting 
points  of  the  team  behavior  (Figure  7).  For  small  values  of  the  variance 
they  ere  very  close  together,  as  the  quality  of  the  observations  Is  very 
good  and  so  the  consulting  DM  Is  willing  to  moke  the  final  team  decision. 
As  the  variance  Increases,  DM  B  becomes  more  willing  to  return  i^=?  (I.e. 

"I  am  not  sure')  end  let  DM  A  make  the  final  team  decision.  As  the 
variance  continues  to  Increase,  the  thresholds  of  the  consulting  DM 
converge  again.  It  might  seem  counter-intuitive,  but  there  Is  a  simple 
explanation.  The  consulting  DM  recognizes  that  the  primary  DM,  despite 
knowing  that  the  quality  of  the  consulting  DM’s  Information  Is  bod,  Is 
willing  to  Incur  the  communication  cost  to  obtain  the  Information.  This 
Indicates  that  the  primary  DM  Is  ’confused’,  that  Is,  the  a  posteiioii 
probabilities  of  the  two  hypotheses  (given  Its  observation)  are  very  close 
together.  Hense,  the  consulting  DM  becomes  more  willing  to  make  the  final 
decision.  After  a  certain  point  (ap^ff62.4)  the  primary  DM  does  find  it 

worthwhile  to  request  for  Information  at  all. 

REMARK  :  Note  In  Figure  7  that  the  thresholds  of  the  consulting  DM 
converge  to  1  which  would  have  been  the  maximum  likelihood  threshold 
had  the  a  priori  probabilities  of  the  two  hypotheses  been  equal.  But,  the  a 
priori  probabilities  i/SFS //f //s  are 

functions  of  the  given  a  priori  probabilities  (le  p,)  and  the  fact  that  the 

primary  DM  requested  for  Information  (le  P(Ujjri  |  H|)  )■  In  fact,  the 
consulting  DM  uses  as  Its  a  priori  probabilities  Its  own  estimates  of  the 


primarij  DM’s  a  posteriori  probabilities.  That  Is : 


^  "IPtH)  P(U.=11H) 

H 


(37) 


From  the  above,  we  deduce  that  for  large  variances  {a^«62)  the  estimates, 

of  the  consulting  DM,  for  the  a  posteriori  probabilities  of  the  primary  DM 
are  very  close  to  .5,  reenforcing  our  point  about  the  primary  DM  "being 
confused." 

Finally,  It  Is  clear,  that  as  the  variance  of  the  consulting  DM 
Increases,  the  percentage  gain  In  cost,  achieved  by  the  team  of  DMs, 
decreases  to  0,  since  the  primary  DM  eventually  makes  all  the  decisions 
alone  (centralized). 


5.3  Effects  of  varuino  the  Communication  Cost 

Increasing  the  communication  cost  is  very  similar  to  increasing  the 
variance  of  the  consulting  DM,  since  In  both  cases  the  team  "gets  less  for 
its  money"  (because  the  team  has  to  incur  an  increased  cost,  either  In  the 
form  of  an  increased  communication  cost,  or  in  the  form  of  the  final  cost, 
because  of  the  worse  performance  of  the  consulting  DM). 

The  thresholds  of  the  primary  DM,  exhibit  the  same  behavior  as  in  5.2 
above  (converging  together  at  Cs.35).  The  thresholds  of  the  consulting  DM 
(Figure  8)  converge  together  for  the  same  reasons  as  in  5.2  above.  Of 
course,  the  thresholds  do  not  start  together  for  small  values  of  the 
communication  cost  (as  in  5.2),  because  low  communication  cost  does  not 
imply  ability  for  the  consulting  DM  to  make  accurate  decisions.  In  fact,  for 
small  values  of  the  communication  cost,  DM  A  Is  compelled  to  request  for 
information  more  often  than  what  is  really  needed  and  so  the  consulting 
DM  returns  more  often  i^=?  (ie  "I  am  not  sure")  and  lets  DM  A  make  the 

team  final  decision. 

Again  it  is  clear  that,  as  the  communication  cost  increases,  the 
percentage  gain  achieved  by  the  teem  of  the  DMs  decreases  to  zero  (as  the 
communication  becomes  more  costly  and  less  frequent,  until  we  reach  the 
centralized  case). 


5.4  Effects  of  varying  the  a  priori  probabilities  of  the  huDothases 
This  case  does  not  present  many  interesting  points.  As  expected,  there  is 
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symmetry  In  the  performence  of  the  teem  eround  the  line  Pq=  0.5  .  The 
closer  p^  Is  to  0.5  the  more  often  Information  Is  requested  by  DM  A 

(Figure  9)  end  the  more  often  ‘I  am  not  sure*  Is  returned  by  DM  B  (Figure 
10).  This  Is  understendeble,  because  the  closer  p^  Is  to  0.5,  the  bigger  the 

a  priori  uncertainty.  Consequently,  the  percentage  improvement  achieved 
by  the  team  of  the  DMs  Is  monotonically  Increasing  with  from  0  to  0.5 

and  monotonically  decreasing  from  0.5  to  1. 


5.5  Effects  of  Imperfect  a  priori  Information 

CASE  1 :  Only  the  consulting  DM  knows  the  true  Pg 

From  Figure  1 1,  where  the  true  Pg  Is  0.8,  we  deduce  that  our  model  Is 

relatively  robust.  If  the  primary  DM's  erroneous  ^  Is  anywhere  between 

0.7  and  0.9,  performance  of  the  team  will  be  not  more  than  10*  away 
from  the  optimum. 

CASE  2  :  Only  the  primary  DM  knows  the  true  Pg 

As  we  see  In  Figure  12,  where  the  true  ^  Is  0.8,  our  model  exhibits 

remarkable  robustness  qualities.  If  the  consulting  DM's  erroneous  Pg  Is  as 

far  out  as  0.01,  the  performance  of  the  team  will  not  be  further  than  7* 
away  from  the  optimal.  This  can  be  explained  by  looking  at  the  consulting 
DM’s  thresholds  as  functions  of  p^  (Figure  13).  We  observe  that  for  values 

of  Pq  between  0.01  and  0.99,  the  thresholds  do  not  change  by  much.  This 

occurs  because,  as  explained  In  detail  In  5.2  above,  the  consulting  DM 
knows  that  the  primary  DM  requests  for  Information  when  Its  a  posteriori 
probabilities  of  the  two  hypotheses  ore  roughly  equal,  which  Is  the  cose 
Indeed.  As  already  stated,  the  consulting  DM  uses  os  Its  a  priori 
probabilities  Its  estimates  of  the  a  posteriori  probabilities  of  the  primary 
DM.  Therefore,  the  consulting  DM’s  estimates  of  the  primary  DM's  a 
posteriori  probabilities  are  good,  besides  the  discrepancy  In  and  the 

team's  performance  Is  not  tampered  by  much. 
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APPENDIX :  Solution  to  the  General  Problem 


ASSUMPTION!:  J(1,Hq)>  J(0,Hq)  ;  J(0,H,)>  J(1,H,)  (38) 

or  It  Is  more  costly  for  the  team  to  err  than  to  be  correct. 

This  logical  assumption  Is  made  in  order  to  motivate  the  team  members  to 
ovoid  erring  and  in  order  to  enable  us  to  put  the  optinel  decisions  in  Irt 
form. 

ASSUMPTION  2:  P(y,  lyp,H,)=  P(y^  IH^)  ;  P(yp  ly„,Hp=  P(yp  |H^)  ;  1=0,1  (39) 
or  the  observations  y^  and  y^  ere  conditionally  independent. 

This  assumption  removes  the  dependence  of  the  one  observation  on  the 
other  and  thus  allows  us,  as  we  ore  about  to  show,  to  write  the  optimal 
decision  rules  as  Irt's  with  constant  thresholds. 

ASSUMPTION  3  :  Without  loss  of  oeneralitu  assume  that : 


P(u^=x  I  UgSl.Ho) 
P(Up=x  I  u,=I,H,) 


P(u^=v  I  u„=l.Ho)  P(u^=z  I  U„=I.Ho) 
P(Up=vlu„=I,H,)  ^  P(U|j=zlu,=I,H,) 


This  assumption  Is  mode  In  order  to  be  able  to  distinguish  between  the 
messages  of  DM  8. 
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THEOREM  1  :  Given  decision  rules  and  ,  and  that  Information  Is 

requested  by  the  primary  DM  for  some  y^eV^  (i.e.  P(u^=i)>0  ),  then  the 

optimal  final  decision  of  the  primary  DM  after  the  Information  has  been 
received,  can  be  expressed  as  a  deterministic  function 

Yf ;  V^x{x,v,2}-*{0J} 
which  Is  defined  as  likelihood  ratio  tests ; 


Where  : 


0  ;  If  Ujsl  and  A„(y„)  i  ot, 

1  ;  otherwise 


and  ; 


Vy«)  = 


PQ  P(y,  \  Hq) 
Pj  Pty«iH,) 


P(Un=1|u,=I,Hj)[J(1,H,)-J(0,H,)l 
P(Vi  I  U„=I ,  Hq)  (J(1.Ho)-J(0,Ho)1 


for  1=x,v,z  (41) 

(42) 

;  1sx,v,2  (43) 


Remark  :  (29)  Is  the  equation  for  the  corresponding  threshold  of  the 
Gaussian  example. 


THEOREM  2  :  Given  the  optimal  decision  rule  u,  (derived  in  Theorem  1), 
a  decision  rule  u^  and  that  Information  Is  requested  for  some  (I.e. 
P(u^^ri)>0),the  optimal  decision  rule  of  the  consulting  DM  Is  a  deterministic 
function 


Yp:Yp**{x,v,2} 

defined  as  the  following  likelihood  ratio  tests  : 

X  If  Aj(yp)2b|  and  A^(yp)  2  b2 

Y^(yp)  =  [  V  If  Aj(yp)<b}  and  yyp)2b3  (44) 

2  If 


pQ  P(ye  I 
Pi  P(yplH,) 


P(Ua=I  I H  J )  TlP(U|  I  u„=l,Uj=v,H, )-  P(u,  I  u„=I,Up=x,H,  )U(u^,H, ) 


P(U„=I  I  Hq)  ^IP(U,  1  U„sI,Up=X.Ho)-  P(u,  I  U„sI,Up=V,Ho)U(u,,Ho) 
P(U„rI  I  H,)  yiPtUf  i  U„=I,Uj=Z,H,)-  P(u^  1  U^=I,Up=X,H,)U(lV,H,) 


P(U„=I  I  Hq)  2(P(fJf  I  U„=I,U*=X,^^)-  P(u,  I  Ua=I,u.=2,Ho)U(u,,Ho) 


P(U„=I  I  H, )  2  Uf  I  u„=I,u.=2,H,  )-  P(u^  1  u„=I,u.= v,H,  )U(u^,H, ) 


P(u«=I  I  Hq)  I  u,sI,Up=v,Ho)-  P(Uf  I  u„=I,Up=2,Ho)U(u^,Ho) 


Equivalently,  we  can  write  : 


where  ; 


and  ; 


X  If  A^(yp)  i  p  1 

Y^(yp)  =  (  V  If  Aj(yp)<Pi  and  Ap(yp)2P2  (49) 
2  If  Vyp)  <  h 


p,  =  max  { b,,  bj) 


p2  =  min  { b2,  b3} . 


Remark :  (31)  and  (32)  are  the  equations  of  the  corresponding  thresholds 
of  the  Gaussian  example. 


LEMMA  1  :  Given  the  decision  rule  of  the  consulting  DM  and  the 
final  decision  rule  of  the  primary  DM,  the  preliminary  decision  rule  u^ 
of  the  primary  DM  can  be  expressed  as  a  deterministic  function 

defined  as  the  following  degenerate  (because  the  thresholds  are 
functions  of  y^)  irts  : 

0  If  Ai(y«)2aj  and  Ai(y„)ia2 

Y«{yaJ  =  (  I  Ax(ya5<®2  l/\(ya)<1/a3 

1  If  A„(y„)<aj  and  l/\(y„)2l/a3 

where  A^(yjj)  is  defined  In  (42)  end  : 

*'  '  J(l,Ho)-J(0,Ho) 

2  P(u,  I  u.=I.u,,g.)  P(uj  I  u.=I,H|  )(J(u,,H, ) .  C)  -  J(0,H, ) 

,  Vi _ 

J(0,Ho)  -  2  1  U«=LUfi.ya)  I  Ua=I.Ho)lJ(Uf,HQ)  ♦  C) 

2  P(Uf  I  u„=I.U5,y„)  P(Uj,  I  U„=I.H,)IJ(U^,H,)  ♦  Cl  -  J(1,H,) 

_  Vi _ _ _ 

J<  I  ,Ho)  -  2  P(u,  I  u„=I.Uj,y,)  P(Uj  I  u.=I.Ho)lJ(u„Ho)  ♦  Cl 

Uf,Up 

We  proceed  to  show  that  the  thresholds  derived  above 
ore  independent  of  y^ . 


(52) 

(53) 

(54) 

(55) 


COROLLARY  1  :  If  for  some  y,^  Information  Is  requested,  according  to 
the  rule  of  Lemma  1  and  u^sx  (or  z)  Is  returned,  then  the  optimal  final 
decision  u.  of  the  primary  DM  Is  alwaus  0  (or  1);  that  Is : 
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P(u^O  I  u^=i,up=x,y^)  =  1  for  all  {y„l  P(u^=i  I  y,)=U  y,6  Y^}  (56) 

and 

P(u^  1 1  u.=i,u^=2,!4)  =1  f  or  all  a.6  (a.  I  P(u.=!  I  a,)»  I ,  u^s  y,)  (57) 


Remark  :  From  Corrolary  1  we  can  now  give  another  interpretation  to  the 
team  procedure:  the  primary  DM  can  decide  0  or  )  using  his  own 
observation  or  can  decide, because  of  uncertainty,  to  incur  the 
communication  cost  (C)  and  shift  the  burden  of  the  decision  to  the 
consulting  DM.  Then  it  is  the  consulting  DM's  turn  to  choose  between 
deciding  0  or  1,  or,  because  of  uncertainty,  shifting  the  burden  back  (atnfl 
cost)  to  the  primary  DM,  which  is  required  to  make  the  final  decision 
given  his  observation  and  the  fact  that  the  consulting  DM's  observation  is 
not  good  enough  for  the  consulting  DM  to  make  the  final  decision. 

According  to  the  above,  we  can  simplify  our  notation  of  the 
consulting  DM's  messages  by  changing  x  to  0,  z  to  1  and  v  to  7 
(which  is  interpreted  as  the  consulting  DM  saying  ’I  am  not  sure'). 


Define  the  following  secondary  variables 


W’  = 


AJo  =  J(1,Ho)-J(0,Ho) 

AJ,  =J(0,H,)-J(1,H,) 
AJqAJ,  [P(u3=I  IH,)’  P(Up=1  IHq)) 


(58) 

(59) 

(60) 


^  AJq  AJ,  |P(Uh=7  I  Ho)P(Un=  1  I  H, )  -  P(Up=?  I  H,  )P(U3=  1  I  Hq)] 
AJq  P(Up=?  I  Hq)  ♦  AJ,  P(u„=?lH,) 

AJq  AJ,(P(u^=?  I  H,)P(Up=0  I  Hq)  -  P(Up=?  I  Ho)P(Up=0  I  H,)l 
AJoP(Up=7|Ho)*AJj  P(up=7|H,) 

^  AJqAJ,  [P(u^=0|Ho)-P(Un=0|H,)l 
AJq^AJ, 


(61) 

(62) 

(63) 
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P(u,=  l  |H,)AJ^ -C 

P(Up.l 

(64) 

IP(u,=  1|H,)»P(u,s?|H,)|aJ, -c 
'  1P(U,S  1 1 H,)  ♦  P(u,»7 1  ^j))  AJi,  ♦  C 

(65) 

P(u,sO|H,)AJ,  *0 

P(Uj=oiHo)aJ|,-C 

(66) 

1P(U,=0 1  H|  )*P(u,= 7  1 H, *  C 
'  (P(up=o  1  Ho)4P(Up=?  1  Hq)!  AJo  -  C 

(67) 

THEOREM  3  :  Given  the  optimum  fine]  decision  rule  u^  of  the  primary 

on  (derived  in  Theorem  1)  and  the  optimum  decision  rule  of  the 

consulting  DM,  the  optimum  decision  rule  for  the  preliminary  decision  of 
the  primary  DM  Is  given  by  a  deterministic  function 

{0,1.1) 


defined  by  the  following  likelihood  ratio  tests  : 


0 

f 

If  A.(y.> 

>a| 

{  I 

if  A.(Ua) 

<a|  and  A*(yo)>02 

(60) 

1 

If  Vu,) 

<  02 

where  ; 

y  ®2,1 

If 

0<  Cimin{W’,w2} 

a,  =  ; 

(  ®2^ 

If 

W2  <  C  s 

(69) 

«1 

otherwise 

- 

If 

0  i  C  i  min  {W^.W^} 

02=  1 

.  83,2 

If 

W’  <  C  s  W’ 

(70) 

Ot 

otherwise 

Remark :  (34)  and  (35)  are  the  equations  of  the  corresponding  thresholds 
for  the  Gaussian  example. 


Figure  1  Problem  Formulation 


optiiIal  policies  are  defined  by  thresholds 


*  BASELINE  PARAMETERS 

Po  = '  Ml =  3 

P(Ho)  =  0.0  ;  P(Hj)  =  0.2 

C  =  0  1 


Figure  3.  The  Gaussian  Case 


FIGURE  4: 


PERCENTAGE  IMPROVEMENT 


FIGURE  5 


PERCENTAGE  LOSS  IN  COST 


